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1. Introduction 

This Progress Report covers the six month period from April 24 to October 22, 1991. 
The completed work during this period is contained in the two papers listed in Section 4 and 
summarized below. Work continues on frequency analysis for transfer function identification, 
both with respect to the continued development of the underlying algorithms and in the 
identification study of two physical systems. In addition, some new results of a theoretical 
nature have recently been obtained that lend further insight into the frequency domain 
interpretation of this research. Progress in each of these areas is summarized below. 
Although not related to the system identification problem, some new results have been 
obtained on the feedback stabilization of linear time lag systems. 

2. List of Scientific Collaborators: April 24 to October 22, 1991: 

Graduate Student Research Assistant 
Graduate Student Research Assistant 
Raytheon Graduate Student Fellow 
Professor and Principal Investigator 
Graduate Student Research Assistant 

♦Received partial support under NAG- 1-1065. 

3. Completed and Continuing Research 

3.1. Parameter Identification for Exact Differential Systems 

A paper has been written entitled “Explicit Least Squares System Parameter 
Identification for Exact Differential Input/Output Models” which emphasizes the explicit 
nature of the modulating function approach to parameter identification for systems that can be 
modeled by an exact differential operator equation of the generic form: 

'L'L8j(Q) p jk(P'> E k( u ’y>= 0 ( 1 ) 

j=0k=l 

where 0 denotes a vector of parameters, Pj k (p) is a polynomial in the differential operator 
p=dldt, [u (t ),>’ (t )] in an input/output (i/o) data pair observed over some time interval [0,7], 
and (gjfjtyEi ) are given functions of their arguments that depend on the specified model. 
As listed in Section 4, this paper will appear in the Proceedings of the Eighth International 
Conference on Mathematical and Computer Modelling. 1 The algorithm described therein util- 
izes the “real-valued” trigonometric modulating functions previously detailed in our earlier 
progress reports. This is in contrast with some new insight recently obtained through the use 
of the “complex-valued” modulating functions. For the purpose of describing this insight in 
some detail, consider the following set of order n modulating functions defined on a time 
interval [0,7]: 


A. V. Fullerton* 
J. Q. Pan 
A. A. Pandiscio 
A. E. Pearson* 
Y. Shen* 


1 Three preprint copies of this paper were mailed to Dr. P. C. Murphy of the Aircraft Guidance 
and Control Branch on September 13, 1991. 
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^(t)=€~ im(Skf (e~ iaQt -\) n , 0</<7=27t/co 0 (2) 

where i=J-l, m is any integer, ©0=271/7 plays the role of a “resolving frequency”, and n 
corresponds to the order of the differential equation under investigation, e.g., the highest 
degree of the polynomials P )k ip ) appearing in the model (l). 2 

Noting from the binomial expansion that <|>"(7) has the equivalent representation 


(3) 


k = 0 


it has been shown that the Modulation Property for this set of functions has the following 
(new) characterization: 

Let Pip) be a linear differential operator of order n and z(7) any sufficiently smooth 
function defined on [0,7]. Then the integration of ty£{t)P ip)z(t) over [0,7] satisfies 

T 

jK(t)P ip )z (t )dt =A” P iim 03 0 )Z (m ) (4) 

o 

where Z(m) is the Fourier series coefficient for the m th harmonic of z(7), i.e., 

T 

Zim)=jzit)e~ im(ikt dt 

o 

and A" is the n th order finite difference operator, i.e., with Q im )=P iim co 0 )Z {m ), 

AQim)=Qim+l)-Qim) 

A 2 Q im )=Q im +2)-2Q (m+l)+l2 i m ) 


A"G(m)=i(-l)* 

k=0 



Qin+m-k). 


Application of the above property to single input/output linear differential system models 
leads to the block diagram in Fig. 1. This diagram indicates the flow of calculations that are 
involved in setting up a standard least squares regression for estimating the parameters 
0= col [-flj, ■ ■ -a n Jj i, • • b n ] in the regression model: 

Joim )=Y (m )0, m =0, 1 ,2 • • (5) 

where the row vector y(m ) of regressors is defined by 

yim )=row[y \im ), -y ^(m ),y ,“(m ), • • y“(m )] (6) 

and the iy“im ),yjim )) are defined in the diagram. The main difference between the least 


2 The fact that each <(>^(7) is an n ,h order modulating function on [0,7] stems from the property 
that this function and its first n - 1 derivatives vanish at both end points, i.e., p k <^^it)=0 at 7=0 and 
7=7, Jk =0,1 ••/!-!. 
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squares estimation based on Eq. (5) and our previous formulation lies in the role of the fre- 
quency index m. Thus, the Fourier series coefficient sequence pair [U (m),Y (m)], which can 
be efficiently and accurately calculated by DFT/FFT techniques given the i/o data [u (OoKOl 
on 0<t<T , is appropriately displayed as the fundamental data-related quantity upon which the 
Fourier modulating function technique is based. As shown in the diagram, the n th order finite 
difference operators and the cascade of frequency modulators which operate on these quanti- 
ties to produce the regressors y(m) clearly show the tradeoff in going from the differential 
equation model to the corresponding Fourier series frequency domain equation model. Previ- 
ously, this “discrete” frequency domain interpretation was masked by the vector-matrix for- 
mulation of the real-valued Fourier based modulating functions. Although this interpretation 
does not change any of the results thus far obtained, in particular the one-shot least squares 
estimation should be identical, it throws the sequential least squares estimation into the proper 
light and may lead to new results in characterizing conditions for uniqueness of the estimate. 
For example, the null space of the n th order finite difference operator is the space of all poly- 
nomials Q(m) of degree n-1, and this fact immediately implies that the i/o data must contain 
at least n frequencies else the regressors will not be linearly independent. Another possibility 
is to model the residuals as a parametrized stochastic sequence, e.g., Poisson, in the discrete 
frequency domain with an attempt to estimate the parameters for this process in addition to 
the system parameters. 

3.2. Parameter Identification for Inexact Differential Systems 

Another interpretation resulting from the above Modulation Property is the least 
squares formulation using the modulating functions (2)-(3) for the class of inexact differential 
operator models defined genetically by: 

£ £ gj (&)Fjk (« O' ) p jk ( P ) E k (« O’ )=0- (7) 

j=Ok=\ 

The difference between this more general class of i/o models and the exact model (1) is the 
allowance for a data dependent term Fj k (u(t),y(t)) multiplying the differential operator poly- 
nomials Pj k (p ). For example, a particle of mass m and displacement y ( t ), subject to a given 
force u (t ) and drag proportional to velocity squared, can be modeled by 

my +0 j (y ) 2 -0 2 u =0. 

Utilizing the differential identity: p 2 (y 2 )=2yp 1 y+2(py) 2 , the preceding model can be rewritten 
into the following equivalent vector-matrix equation which is of the form (7): 



1 

N> 

O 

o 

1 


y 

[m ,0!,02] 

-yp 2 Vip 2 0 


y 2 


0 0-1 


u . 


Given the i/o data [u(r),y(0] on [0,7] and the data-related signals Wj k (t)=Fj k (u(t),y(t )) 
on [0,T], assume that each Wj k (t) has the Fourier series representation: 
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It can be shown that application of the Modulation Property (4) to the model (7) leads 
to the following explicitly defined function for least squares minimization: 


/(8)= S S;(fi)St(8>/V (8) 

j,k=0 

where the jk th component of the real symmetric nonnegative definite matrix R is defined by 

M _ 

Rjk='LK’ij{m)n k {m) (9) 

m - 0 

with specified nonnegative “frequency” weights X m . Given the Fourier series coefficients 
V k (m) of the data-related functions v k (t)=E k (u (t),y (t)) on [0,7], i.e., 

T 

V k (m )=Jv t (t )e~ bn ^ dt , 
o 

the regressors Yy(m) are obtained by the following equations: 

n l 

X ) )= £ W jk (m )<8H jk (m ) 

*=I 

where 


y jk (m)=A n Q jk (m) 

and 


Qjk ( m )= p jk ( im ) v k ( m )• 

The convolution implied above is the linear convolution between Fourier series type 
coefficients as defined by 

W{mymm)= X W(iy^m-l). 

I =—°o 


The flow of calculations involved in the above formulation is shown in Fig. 2 which 
includes the flow of calculations for the more specialized exact model (1). Notice that the 
least squares problem for the exact model does not entail any convolutions in the discrete fre- 
quency domain. The presence of these convolutions in the case of inexact models is con- 
sistent with the well-known general property of Fourier analyses in that multiplication in the 
time domain entails convolution in the frequency domain, and vice versa. Here the frequency 
domain is the discrete frequency domain of Fourier series coefficients, and the presence of 
such convolutions imposes a smoothness condition on the “inexact” data-related signals 
Wj k (t ) to the extent that only a finite number of the corresponding Fourier series coefficients 
Wj k (l), /=4),±1,±2, ■ ■ ±L, can be calculated in practice. This L has to be less than the 
number N of discrete-time samples of the i/o data, [u(jh)y(jh)], j =0,1 • ■ N, Nh=T, which 
are used to calculate the Fourier series coefficients [V k (m),Wj k (m)] by DFT/FFT techniques. 
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3.3. Comparison With Other Techniques 

We are currently attempting to compare the Fourier modulating function technique to 
other available methods in two problem areas: The identification of coefficients in a linear 
differential system in which the available method is the Prediction Error Method in 
MATLAB’s Identification Toolbox by L. Ljung, and the high resolution frequency estimation 
problem in which we have coded up the High Order Yule Walker algorithm for simulation 
purposes. The results are thus far quite encouraging in favor of the Fourier modulating func- 
tion technique. These results will be written up when completed. 

Another area in which we have made some comparisons is the “frequency analysis prob- 
lem” of estimating the transfer function G(i'co) for a linear system given the i/o data 
[u (f ),y (/)] over a sequence of time intervals [tj,tj+T], j =0,1,2 • • N, where the modulating 
function technique facilitates estimation of G(ito) at selected knots (£=k (t> 0 , £=0,1 • • M , with 
the resolving frequency co 0 related to the lengths of the time intervals by co 0 =27t/T . The short 
paper entitled “Frequency Analysis Via the Method of Moment Functionals” includes com- 
parative data with the classical cross correlation method and the transfer function obtained by 

the direct ratio of Fourier transforms of the i/o data. 3 Again, the results of these comparisons 
are quite encouraging. A full length version of this paper will be prepared at some future 
time. It may be that it will prove advantageous to incorporate the insight obtained by the 
newly characterized Modulation Property described in Eq. (4) above. 

3.4. Physical System Identification 

Two physical system identification projects are underway and a third is planned for the 
future. One project is the verification study of a fourth order Butterworth filter that was 
designed and built by Yan Shen to low-pass filter the data in a wind tunnel setup at Brown 
University, and another is the dynamic modeling of room acoustics (also being carried out by 
Yan Shen) which is part of a microphone array project being carried out at Brown under the 
direction of Prof. Harvey Silverman. These projects are helping “fine-tune” the algorithms 
by focusing on the practical problems of order determination and computational considerations 
for high order system models. The first of these is nearing completion and will be submitted 
in report form in the not-too-distant future. 

The third project will focus on modeling for the F-18 aircraft based on data forwarded to 
us by E. A. Morelli. We shall start this project after we have completed the Butterworth filter 
verification study. 

4. Publications and Presentations 

Pearson, A. E., “Explicit Least Squares System Parameter Identification for Exact Differential 
Input/Output Models.” Regular Paper to appear in the Proceedings of the Eighth ICMCM, 
Univ. of Maryland, College Park, MD, April 1991. 

Pearson, A. E. and J. Q. Pan, “Frequency Analysis Via the Method of Moment Functionals.” 


3 Three preprint copies of this paper were also mailed to P. C. Murphy on September 13, 1991. 
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Short Paper to appear in the Proceedings of the 30 th IEEE CDC, Brighton, UK, Dec. 1991. 

October 3 Presentation at the University Grantees Workshop, NASA Langley Research 
Center, Aircraft Guidance and Control Branch. 

October 21 Seminar Presentation “Parameter Identification for Differential System Models 
Via Fourier Modulating Functions” at Northwestern University, Dept, of Electrical Engineer- 
ing and Computer Science, Evanston, IL. 

October 22 Seminar Presentation “Modeling and Parameter Identification for Differential Sys- 
tems” at the University of Illinois, Dept, of Mechanical Engineering, Urbana-Champaign, IL. 
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SISO MODEL: 



Fig. 1 Linear System Identification 





Fig. 2 Nonlinear System Identification 



